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Consider a discrete probability distribution, represented by an /i-vector a. This paper treats the 
problem of adjusting a as little as possible, in the sense of minimizing max,|x,— «,-|, to obtain a dis- 
tribution x which satisfies given componentwise bounds L ^ x ^ U, or a given componentwise ranking, 
or both. The resulting linear programs are shown to admit special explicit solution algorithms. 
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1 . Introduction 

An n-vector x will be called a probability vector if its components X{ are nonnegative and sum 
to unity. This paper deals first with the following problem: given a probability n-vector a, and 
ra-vectors L and U, to find a probability rc-vector x which minimizes 

F(x) = maxi\xi — cn\ (1.1) 

subject to the constraints 

O^L^x^U. (1.2) 

For the problem to be feasible, it is obviously necessary that 

Li^Ut (alii), (1.3) 

XJLi^l^XiUu (1.4) 

and so these conditions are imposed at the outset. 

The motivating situation is one in which values must be attributed to the components xi of an 
unknown discrete probability distribution. One type of information, e.g., data on some previous 
analogous situation, suggests the estimate a. Another, e.g., theoretical analyses or subjective 
opinions on the "present" situation, imposes the componentwise bounds (1.2). If a does not satisfy 
(1.2), a common procedure is to "adjust a as little as possible" so as to satisfy (1.2). Here the 
minimization of F(x) is taken to express the "as little as possible" criterion in replacing a by a 
suitable x. 

After some preliminaries are disposed of in section 2, a solution method for this problem is 
presented in section 3. In fact, the method is developed for the more general version in which 
(1.1) is replaced by 

F(x) = max,- {wi\xi — cn\}, (1.5) 

where the w\ are prescribed positive "weights." This corresponds to the case in which the accuracy, 
with which x approximates a, is more important for some components than for others. 
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Section 4 considers the analogous problem in which the componentwise-bound constraints 
(1.2) are replaced by a given componentwise ranking 

X!^X 2 ^ ... ^Xn. (1-6) 

Then, in section 5, the problem with both bounds and ranking is treated. (Both of these sections 
deal only with the "unweighted" objective function (1.1); the weighted version can be handled as 
a linear program, but our concern is with more explicit methods.) 

Related work is found in [1, 2, 3] 1 . The present paper, though self-contained, isolates in a 
form more convenient for reference some material appearing in [1]. 

2. Preliminaries 

This section contains solution methods for four subproblems which will arise later. The 
material is presented for the sake of completeness; the same or similar problems have surely arisen 
in the literature as phases in other optimization analyses. In each case below, the solution method 
provides a constructive proof that certain obviously necessary conditions, for the existence of solu- 
tions, are also sufficient. 

PROBLEM I. Given rc-vectors A and B, and number S, find an rc-vector y such that 

A^y^B, (2.1) 

2*y*=S. (2.2) 

The conditions _ 

A^B, (2.3) 

XiAi ^ S ^ XiB u (2.4) 

which are clearly necessary for Problem I to have a solution, will be assumed to hold. If S = XiBi 
then y = B is clearly a solution, so we assume S < SiJ5 z . Then k = n has the property 

^ k B j + X j>k A j >S, (2.5) 

but k = does not, and so there is a smallest ke{l, 2, . . . , n) with this property. For that k, not 
only (2.5) but also 

$ j<k B j +3, >k A j ^S (2.6) 

holds. Now set , . 

Yj = Bj for j<k, 

Yj = Aj for j>k, 

y k = S — %^ k yj; 

that A k ^y k ^B k follows from (2.5) and (2.6). 

PROBLEM II. Given /i-vector Z, positive rc-vector w, and number S, find the minimum value 
z* of z such thatz ^ and 

S?max{0, Zi-zlw}^S. (2.7) 

The condition S ^ 0, which is clearly necessary for Problem II to have a solution, will be as- 
sumed. Moreover, if S = 0, then each of the nonnegative summands in (2.7) would have to vanish, 
yielding 

z* = max {0, max* wtZ\\ 

as the solution; thus from now on we assume S > 0. Furthermore if Z\ ^ 0, then the ith summand 
in (2.7) will vanish for every z ^ 0, and so such Z\ can be deleted from the problem in advance; 
if none are left then clearly z*= is the solution. So Z\ > will be assumed. 



figures in brackets indicate the literature references at the end of the paper. 
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Now choose Z n+i = Q and any w n +i > 0, renumber so that 

W\Z\ ^ W2Z2 ^ • • • ^ w„Z n > w n+ iZ n +i — 0, 
and set 

Zf^iZi-wjZjVtiUwi). 

The sequence {Z*}'J +1 is given by the recursion 

Zf+i = Zf+ (wjZj-Wj+iZj+i) 2{(llwi), 

which shows it to be nondecreasing. And unless S;'Z,<S (in which case z*=0 is the solution), 
we have 

Z 1 *=0<S«2«Zi=Z* +1 . 

Thus there is a unique Je{l, 2, . . . , n} such that 

= Z*«Z*=s. . .«Z*<S=sZ* +1 =s. . .«Z* +1 . (2.8) 

If ^ z < wj+iZj+i , then 

2,max{0, Zi-z/wi} ^2( +1 Zj-z Zi+ ] (l/wj) >Z% X ^S, 
so that z does not satisfy (2.7). But \{w J+ \Zj+\ ^ z ^ w./Z. ; , then (2.7) becomes 

S/^-zSfU/z^^S 

which is equivalent to 

z^z* = {2{Zj-S)/${(llwi)- (2.9) 

By use of (2.8), the value of z* proposed in (2.9) is easily verified to satisfy wj + iZ J+l ^ z ^ wjZj, 
and so is indeed the smallest z ^ obeying (2.7). 

PROBLEM III. Given rc-vector Z, positive ra-vector w and number S, find the minimum value 
z** of z such that z ^ and 

Si'minjZ,, z/wi}^S. (2.10) 

The condition 

X'tZi^S, (2.11) 

which is obviously necessary if (2.10) is to have a solution, will be assumed. If equality holds in 
(2.11), then for each i the ith summand in (2.10) must equal Z,, so that the solution is 

z**= max {0, max, w x Z\\\ 

thus from now on we assume strict inequality in (2.11). Moreover, if Z\ < then for any z ^ 0, 
Z x could be replaced by on the left-hand side of (2.10) without change in value; hence it can be 
assumed that all Z;^ 0. Now z**= will give the solution if S ^ 0, so we also assume S > 0. 
Choose Z,,+i = and any w n +\ > 0, renumber so that 

W X Z\ ^ W 2 Z 2 ^ . . . ^ W n Z n 22= W n + lZ n +l = 0, 

and set 

Z/* = wjZj S-i ( Huh) + 2/+ 1 Z, . 
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The sequence {Z**}? +1 obeys the recursion 

Zfii^Zft+iwj+iZj+i-wjZj) S-i (Urn) 

and so is nonincreasing. Since 

ZSfr=0<S<2jZ,=Z 1 **, 

there is a unique Je{l, 2, . . ., n} such that 

Zf>Zjr>. • .*'ZJ *S>ZJ + i*. . .^Z*+i = 0. (2.12) 

Now if z ^ Wj+i, then 

2,- min {Z u zM ^ z5i +1 (l/^i) + S% 2 Zi <Zj;, < S 

so that z does not satisfy (2.10). But if w,j+\Zj+\ ^ z^wjZj, then (2.10) becomes 

which is equivalent to 

z ^ z **= (S-^ZjjWdlwi). (2.13) 

By use of (2.12), the value of z** proposed in (2.13) is easily verified to satisfy wj+iZj+i ^ z ^ ^./Zj, 
and so is indeed the smallest z^O obeying (2.10). 

PROBLEM IV. Given n-vectors A and B, and number S, find an n-vector y such that 

A^y^B, (2.14) 

2*yr=S, (2.15) 

y x ^ y 2 ^ . . . ^y n . (2.16) 

Here it is convenient to define nondecreasing sequences {A^ and {flj}?, forming the com- 
ponents of respective vectors A' and B ' , by 

A[ = max^j, B\= min/^Bj. (2.17) 

Then (2.16) and (2.14) are readily proved equivalent to (2.16) and 

A'^y^B'. (2.14') 

Thus necessary conditions, for Problem IV to have a solution, are 

A' ^B' (i.e.,4<£j fori <./'). (2.18) 

S^S^SjB', . (2.19) 

These will be assumed to hold. 

If A' = B',theny = A'=B' is the solution. For A' ¥- B', define 

0=[S-2 i A' i ]l[Z i B'-Z i A' i ] 
and set 

y = A' + 0(B'-A'). 
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Then (2.15) follows from the choice of 0, and (2.14') becomes ^ 6 ^ 1, which follows from (2.19). 
As for (2.16) , i l^j implies that A\ ^ A] and B\ ^ B], so that 

y i ={\-e)A\ + eB' l ^{\-0)A' j + 6B' j = yj. 

(The same approach yields a simpler solution method for Problem I than the one given above.) 

3. Solution for Componentwise Bounds 

We now return to the problem posed at the beginning of the paper, with objective function 
(1.5). It can be rephrased as the following linear program: choose a number z and a probability 
ra-vector x, to minimize z subject to the conditions 

O^L^x^U, (3.1) 

z^Wi(xi-ai) (alii), (3.2) 

z^Wi(ai-Xi) (alii). (3.3) 

The constraints of the linear program, including the requirement that x be a probability vector, can 
be written as follows: 

max {Lj, cii — z/wi} ^Xi ^ min {Uu di + z/wi} (all i), (3.3a) 

2i*i=l. (3.3b) 

A redundant constraint z^O can also be imposed. Thus the aim is to determine the smallest 
z ^ for which the system (3.3a), (3.3b) has a solution x. 

For any fixed z, the system is an instance of Problem I in Section 2, withS= 1 and 

Ai= max {L h a\— z/wi}, Bi= min {!/,-, ai + z/wt}. 

By the analysis in Section 2, a solution x exists if and only if 

max{L,, cii — z/wi} ^ min {[/,, ai + zjwi} (all i) , (3.4) 

£< max {L,, a,— z\w\\ ^ 1, (3.5) 

Si min {U u ai+zlwi} 2* 1. (3.6) 

So the objective is to determine the smallest value z min of z which will satisfy (3.4), (3.5) and (3.6). 
Now the left-hand side in (3.4) is nonincreasing in z, while the right-hand side is nondecreasing. 
The left-hand sides of (3.5) and (3.6) are respectively nonincreasing and nondecreasing in z. It 
follows that, if 

z° = least z obeying (3.4), 

z* = least nonnegative z obeying (3.5), 

z** = least nonnegative z obeying (3.6), 
then 

z min =max{z°, z*, z**}. (3.7) 

Since Li ^ Uu (3.4) reduces to 

at — z/wi ^ Ut, L}^ a i + z/wi (all i), 

and so z° is readily determined as 

z°— max {max(Wi(ai— Ui) , max/w^L, — a,)}. (3.8) 
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Next, (3.5) can be rewritten 

2*max {0, (ai-Li) -z/w l ] ^ l-SiZ*, (3.9) 

so that determining 2* is an instance of Problem II in Section 2, with 

Z = a — L, 5=1— Slit . 

The feasibility condition S ^ is satisfied by virtue of the first part of (1.4). 

Finally, (3.6) is equivalent to 

Xtmm{Ui-auzlwi} ^0, (3.10) 

so that the determination of z** is an instance of Problem III in Section 2, with 

Z = U-a, S = Q. 

The feasibility condition 2 '/Z, ^ S is satisfied by virtue of the second part of (1.4). 

With z°, z*, and z** determined, z min can be found from (3.7). Then a single optimizing xcan 
be found by applying, to the previously-mentioned instance of Problem I with z = z min , the solution 
method given in Section 2. Concerning the nonuniqueness of x, compare Section 5 of [1]. 

4. Solution for Componentwise Ranking 

The next problem to be considered is the determination of a probability rc-vector x, among 
those which obey the componentwise ranking 

Xi ^ X 2 ^ . . . ^X n , (4.1) 

which minimizes 

F(x) = max,- \x{ — ai\. 

This too can be reformulated as a linear program, namely to select a number z and a vector x ^ 0, 
so as to minimize z subject to 

2i*i=l, (4.2) 

z^Xi — ai (all£), (4.3) 

z^cti — Xi (alii)- (4.4) 

Conditions (4.3) and (4.4), together with x^ 0, can be abbreviated to 

max {0, at— z} ^ Xi ^ ai + z. (4.5) 

A redundant constraint z ^ can also be imposed. Thus the aim is to determine the smallest 
z ^ for which the system (4.1), (4.2), (4.5) has a solution x. 

For any fixed z 5= 0, the system is an instance of Problem IV in Section 2, withS= 1 and 

At= max {0, dj — z},Bi= a\-\- z. 

It is convenient to define vectors a* and a**, with nondecreasing component sequences given by 

df — maxj<=j di, d** = miuj^idi. 

Then the vectors A' and B', described in Section 2's analysis of Problem 4, are given by 

^ = max{0,af-z},BJ = af* + z. 
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The conditions (2.18) and (2.19), for Problem IV to be feasible, become 

max {0, (ii — z} ^ tt;-f z for i ^7, (4.6) 

2 f -max{(), af-z}^\ s£ 2* (a** + z). (4.7) 

Now the objective is to find z min , the smallest z ^ satisfying (4.6) and (4.7). Arguing as in 
Section 3, one finds that if 

z°= least nonnegative z obeying (4.6), 

z*= least nonnegative z obeying first part of (4.7), 

z** = least nonnegative z obeying second part of (4.7), 

then 

z min = max {z°, z*, 2**}. (4.8) 

Since z ^ and each aj 5= 0, z° is readily determined from (4.6) as 

z°=max {0, maxima* — a,)/2}. (4.9) 

Since a** ^ a,, implying 

z** is readily determined from (4.7) as 

z**=(l-2«a,**)/n. (4.10) 

Finally, the determination of z* is an instance of Problem II, with S=l, Wj = 1, and Zi — a*. 

5. Solution for Componentwise Bounds and Ranking 

The final version to be treated is the determination of a probability rc-vector x which minimizes 
max,-|jt/ — «;|, subject both to the ranking condition 

X\ ^X 2 ^ • • • ^X n , 

and to the componentwise bounds 

The analysis proceeds much as in the preceding Section, with (4.5) replaced by 

max {Li, cij — z} ^Xi^ min {[/,-, a,-hz}. (5.1) 

Again we have an instance of Problem IV, with S= 1, and with 

Ai=n\dix {Li, cii — z}, Bj = min {f/,-, a/-hz}. 
As before, set 

a * = maxj^j a j , a * * = min j ^ ,• aj , 
and also put 

L I — m ax j <= i L j . U[ = mi n j =» , Uj . 
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Then the vectors A' and B' are now given by 

^i' = max {L/, af — z), B[ = min {U\, a?* + z}. (5.2) 

We continue to have 

z min = max{z°, z*, z**} , (5.3) 

where 

z° = least z for which A ' ^ B ' , 

z* = least nonnegative z for which S/^/ ^ 1, 

z** = least nonnegative z for which XiB\ ^ 1. 

The problem defining z°, and hence the overall problem, has a solution only if 

Lt^Uj fori^y. (5.4) 

Assuming this holds, the remaining conditions defining z° are (for i ^j) 

Li ^ aj-hz, aj — z ^ Uj, di — z^ cij + z, 
and so 

z =msiXi^j max{L t — cij, (if — Uj, (a; — aj)/2}. (5.5) 

The condition defining z* reads 

S<max{L|, af—z) ^ 1,, 
which can be rewritten 

Simax{0, (a?-L9~z}^l-XiIf. 
This is an instance of Problem II, with a?i=l, 

Zi = af-Ll, S= 1-2,04. 
The consistency condition S ^ 0, i.e., 

SiL/^1, (5.6) 

is required for a solution to exist. 

The condition defining z** reads 

S/min{C/;-, ap + z}2*l, 

which can be rewritten 

Simin{t//-af*,z}^l-2iaf*. 

This is an instance of Problem III, with wt= 1, 

Zi=Ul-a?*, S=l-Xiaf*. 

The consistency condition SjZj ^ S, i.e., 

Sit// ^ 1 (5.7) 

is required for a solution to exist. 

Thus the conditions on the data L and U, for the componentwise bounds and ranking to be 
consistent, are given by (5.4), (5.6) and (5.7). 
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